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ABSTRACT 


A  Demonstration  Project  authorized  under  the  Civil 
Service  Reform  Act  of  1978  was  developed  and  implemented  at 
the  Naval  Weapons  Center,  China  Lake  and  the  Naval  Ocean 
Systems  Center,  San  Diego.  The  Project  was  designed  to 
increase  the  participation  of  line  managers  in  the  personnel 
management  function,  and  to  establish  a  direct  link  between 
pay  and  performance  evaluation. 

This  paper  contains  a  study  of  managerial  opinions  and 
attitudes  toward  the  Demonstration  Project.  Managerial 
survey  data,  analysis,  and  conclusions  are  presented,  and  a 
cost/effectiveness  model  is  developed  based  on  data  obtained 
after  two  full-year  cycles  under  the  Project. 
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I.  OBJECTIVES  OF  THE  DEMONSTRATION  PROJECT 


The  Naval  Weapons  Center  at  China  Lake,  California,  is 
currently  participating  in  a  joint  Demonstration  Project  in 
cooperation  with  the  Naval  Ocean  Systems  Canter,  San  Diego, 
California.  The  Project  was  authorized  by  the  Civil  Service 
Reform  Act  of  1978,  Title  VI  of  the  United  States  Code  of 
Federal  Regulations  (Ref.  1].  To  date,  the  Project  is  the 
only  one  in  existence  in  the  Federal  Government,  as  approved 
by  the  Office  of  Personnel  Management  (OPM)  under  the  Act. 
The  objective  for  allowing  such  an  experiment  was  to 
determine  if  removal  or  modification  of  some  of  the  existing 
regulations  affecting  Federal  civilian  employment  could  faci¬ 
litate  increased  efficiency  and  productivity. 

Under  existing  Federal  regulations,  the  functions  of 
personnel  recruitment,  selection  and  promotion,  position 
classification,  and  pay  administration  are  closely  controlled 
by  detailed  rules  and  procedures  administered  through 
personnel  specialists  assigned  at  each  Federal  agency.  These 
personnelists  are  subject  to  periodic  inspection  by  OPM 
auditors,  and  compliance  with  regulations  is  strictly 
enforced.  Very  little  latitude  is  allowed  in  the  application 
of  these  regulations  to  the  personnel  management  functions  at 
individual  agencies.  The  real  needs  of  line  managers  for  the 
authority  and  autonomy  to  supervise  their  subordinates  are 
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often  overlooked  by  these  inflexible  regulations.  This 
situation  has  fostered  the  development  of  a  somewhat 
adversarial  relationship  between  managers,  who  attempt  to  get 
the  job  done,  and  personnelists,  who  must  constantly  ensure 
that  the  rules  are  followed.  The  end  result  of  this 
situation  is  counter-productive  to  increasing  efficiency  of 
human  resources  management  at  Federal  activities.  In 
recognition  of  this  dilemma,  the  Act  encouraged  presentation 
of  new  ideas  designed  to  minimize  the  internal  conflicts  at 
agencies  over  the  personnel  management  functions  which  are 
actually  the  responsibility  of  line  management  to  accomplish. 

The  intent  of  this  Demonstration  Project  is  to  increase 
the  participation  of  line  managers  in  the  personnel 
management  function  and  to  establish  a  direct  link  between 
pay  and  performance  evaluation.  The  rationale  for  the  former 
purpose  is  to  decentralize  the  personnel  management  function, 
and  to  place  it  more  directly  in  the  hands  of  line  managers, 
while  the  rationale  for  the  latter  purpose  is  to  comply  with 
the  intent  of  the  Act.  Thus,  the  Project  would  attempt  to 
meet  the  internal  needs  of  the  organization  while  also 
complying  with  external  goals  mandated  by  law.  It  was  not 
known  at  the  inception  of  the  Project  whether  or  not  both  of 
these  ends  could  be  successfully  accomplished.  The  Project 
would  be  required  to  "demonstrate"  to  external  evaluations 
new  mechanisms  for  personnel  management  in  order  to  assess 


7 


their  usefulness  and  potential  for  applicability  in  the 
Federal  Service.  At  the  same  time,  the  Project  must  be 
workable  and  acceptable  to  the  participants  who  have  their 
own  internal  criteria  for  judging  its  success. 

Success  of  the  Project  is  being  measured  by  external 
evaluators  in  terms  of  the  impact  on  recruitment  of 
scientists  and  engineers  for  the  laboratories;  retention  of 
high  performers;  responsiveness  of  personnel  management 
processes  to  the  needs  of  line  management;  and,  the 
relationship  between  on-the-job  performance  and  performance- 
based  rewards.  These  measurements  are  considered  to  be  key 
indicators  of  productivity  and  efficiency  at  Navy 
laboratories. 

This  paper  dees  not  attempt  to  evaluate  the  entire 
Demonstration  Project.  Rather,  this  study  will  focus  on 
specific  aspects  of  the  Project  which  have  the  potential  for 
affecting  line  managers  in  the  performance  of  their  jobs.  An 
assessment  will  be  made  of  the  Project  from  a  managerial 
standpoint  to  determine  how  successful  it  has  been  in  meeting 
the  needs  of  managers  for  participation  in,  and  control  over, 
the  personnel  management  functions  of  position  classification 
and  performance  evaluation. 

A.  BACKGROUND 

During  the  administration  of  President  Carter  the  Civil 
Service  Reform  Act  was  formulated.  The  Act  was  passed  by  the 


8 


United  States  Congress  on  13  October  1978,  to  become 
effective  in  January  1979.  The  Act  was  intended  to  improve 
the  productivity,  honesty  and  competency  of  the  Federal 
service.  As  a  result  of  the  Act,  the  Civil  Service 
Commission  was  abolished  and  replaced  by  the  Office  of 
Personnel  Management  plus  a  separate  Merit  Systems  Protection 
Board . 

Another  requirement  of  the  Act  was  the  design  of  new 
performance  appraisal  systems  for  all  employees  which  would 
appraise  performance  on  the  basis  of  written  standards. 
Employee  participation  in  the  development  of  standards  was 
encouraged,  and  communication  of  the  standards  to  affected 
employees  was  required.  Good  performance  was  to  be  rewarded, 
poor  performance  was  to  be  improved,  and  continuing  poor 
performance  was  to  be  dealt  with  through  reassignment, 
demotion  or  removal  of  poor  performers.  Many  of  the  features 
contained  in  the  section  on  performance  appraisal  resembled 
the  practice  of  "Management  by  Objectives",  which  will  be 
discussed  later  in  this  Chapter. 

The  Merit  Pay  System  was  established  by  the  Act,  to 
directly  tie  compensation  to  performance  for  senior  level 
employees,  grades  GS-13  through  15,  in  managerial  positions; 
however,  this  system  did  not  apply  to  non-m anage r i al 
employees,  other  employees  in  grades  GS-1  through  12,  and 
ungraded  workers.  The  performance  appraisal  systems  for 


9 


excluded  employees  remained  essentially  the  same  as  they  were 
prior  to  the  Act,  where  pay  increases  for  satisfactory 
performance  were  granted  on  a  periodic  basis.  As  an  employee 
advanced  in  tenure,  pay  was  automatically  adjusted  to  a 
higher  step  at  one,  two  and  three  year  intervals.  Unless 
specific,  documented  action  was  taken  by  the  supervisor  to 
withhold  such  an  increase,  the  raise  in  pay  was  automatically 
granted.  Performance  evaluation  was  accomplished  only  on  an 
annual  basis,  with  each  employee's  performance  being  assessed 
by  the  immediate  supervisor  against  a  scale  of  general  work 
attributes  and  personal  characteristics  which  were  not 
directly  related  to  the  actual  job  itself.  In  many  cases,  no 
discussion  of  this  rating  ever  took  place  between  the 
supervisor  and  the  employee. 

Provisions  of  the  Act  allowed  Federal  agencies  to 
initiate  Demonstration  Projects  to  experiment  with 
alternative  methods  of  personnel  management  which  would 
incorporate  the  basic  premises  of  the  Act.  The  Act  limited 
the  number  of  such  experiments  to  not  more  than  10,  covering 
no  more  than  5,000  employees  and  lasting  up  to  5  years  in 
duration.  Provisions  to  waive  certain  portions  of  Federal 
law  governing  civilian  employment  in  order  to  facilitate 
implementation  of  these  projects  were  included. 

At  the  Naval  Weapons  Center  (NWC)  and  the  Naval  Ocean 
Systems  Center  (NOSC)  the  determination  was  reached  that 
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existing  Federal  Civil  Service  regulations  did  not  allow 
sufficient  flexibility  to  attract  and  retain  the  caliber  of 
personnel  required  at  Naval  laboratories.  Existing 
regulations  strictly  limited  the  entry  level  salaries  that 
could  be  offered  by  recruiters  in  competition  with  the 
private  sector.  Once  hired,  an  engineer  or  scientist  could 
progress  in  pay  and  status  only  up  to  a  specified  full 
performance  level.  To  progress  beyond  that  level  required 
the  assumption  of  managerial  duties.  This  presented  a 
serious  dilemma  for  researchers  who  were  technical  experts 
and  excelled  in  their  work.  They  were  forced  to  advance  into 
managerial  positions  even  though  they  may  have  lacked  the 
desire  to  give  up  actual  research  work  to  do  so,  or  remain 
dead-ended  in  their  jobs.  The  pay  and  position 
classification  systems  in  existence  prohibited  resolution  of 
the  situation;  therefore,  these  systems  became  primary 
targets  for  renovation  through  the  Project. 

The  joint  proposal  would  incorporate  complete  revisions 
to  the  pay  and  position  classification  systems.  In  order  to 
satisfy  the  intent  of  the  Act,  these  new  systems  would  be 
meshed  with  a  pay  for  performance  concept.  The  approach  to 
formulate  the  proposal  was  to  make  it  a  joint  effort  between 
the  Personnel  Department  Staffs  at  NWC  and  NOSC  with 
assistance  provided  by  the  University  of  Southern  California. 
The  proposal  was  published  in  the  Federal  Register  on  4 
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December  1979,  public  hearings  were  conducted  to  solicit 
comments,  and  the  final  proposal  [Ref.  2]  was  submitted  to 
the  Office  of  Personnel  Management  for  approval.  OPM 
approval  was  ultimately  obtained  to  authorize  specific 
waivers  of  those  portions  of  Federal  law  which  would 
interfere  with  implementation  of  the  Demonstration  Project, 
and  the  Congress  was  notified  of  these  waivers. 


' 


B.  IMPLEMENTATION 

On  14  November  1979  Task  Teams  were  established  at  NWC 
and  NOSC  in  each  of  the  major  areas  of  focus,  the  members  of 
which  included  line  managers,  employee  representatives,  and 
members  of  the  Personnel  Department  Staff..  Each  team 
developed  comprehensive  plans  for  implementation  in  their 
area  of  concern,  and  the  total  effort  was  coordinated  between 
the  two  laboratories.  The  Demonstration  Project  was 
implemented  at  China  Lake  and  San  Diego  in  July  1980  for  an 
initial  population  consisting  of  approximately  2,700 
scientific,  engineering  and  senior  professional  employees  at 
both  laboratories.  Groups  of  administrative  and  technical 
specialists,  technicians,  and  clerical  employees  were  added 
to  the  Project  on  an  incremental  basis  until  the  5,000 
employee  limit  was  approached  in  September  1982.  As  each  new 
group  was  added  to  the  Project,  they  received  comprehensive 
training  to  introduce  them  to  the  new  procedures  and  explain 
the  rationale  behind  them. 
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Two  designated  control  laboratories  were  the  Naval  Air 
Development  Center,  Warminister,  Pennsylvania,  and  the  Naval 
Surface  Weapons  Laboratory,  Dahlgren,  Virginia.  These  control 
labs  would  function  under  existing  regulations  governing 
Federal  personnel  management.  Data  would  be  collected  perio¬ 
dically  at  the  control  laboratories  and  compared  with 
comparable  data  from  China  Lake  and  San  Diego  in  the  three 
major  areas  affected  by  the  Demonstration  Project.  External 
evaluation  was  initially  performed  by  the  University  of 
Southern  California  to  track  progress  and  report  significant 
findings.  An  OPM  contract  for  external  evaluation  was  later 
awarded  to  the  firm  of  Coopers  and  Lybrand,  and  in  September 
1982  the  external  evaluation  function  was  taken  over  by  OPM. 
Internal  Evaluation  Teams  were  also  established  at  China  Lake 
and  San  Diego  to  monitor  the.  project. 

C.  SYSTEM  MECHANICS 

Under  the  Demonstration  Project,  managers  develop  annual 
performance  plans  (Exhibit  1)  for  each  employee  participating 
in  the  Project.  These  plans  contain  specific  goals  and 
objectives  to  be  met  as  well  a  the  standards  for  evaluating 
employee  performance.  Employees  are  encouraged  to  participate 
in  the  development  of  their  own  performance  plans,  and 
discussions  take  place  between  supervisors  and  employees  in 
order  to  ensure  that  an  understanding  is  reached  on  the 
content  of  the  plan  for  each  individual  employee.  A  minimum 


of  two  monitoring  sessions  must  be  conducted  with  each 
employee  during  the  one-year  performance  evaluation  period, 
and  a  final  written  assessment  is  accomplished  at  the  end  of 
the  year  by  the  immediate  supervisor.  This  final  rating  is 
reviewed  by  the  second  level  supervisor,  and  if  the  overall 
performance  exceeds  the  "fully  successful"  level  the  rating 
is  subject  to  further  review  and  approval  by  a  Departmental 
Performance  Review  Board  (PRB)  [Ref.  3].  The  PRB  has  the 
authority  to  award  pay  increases  commensurate  with  the  degree 
by  which  overall  performance  exceeded  expected  results 
contained  in  the  performance  plan.  PRB  decisions  also  take 
into  consideration  adherence  to  a  payout  guideline  issued  by 
top  management;  however,  there  is  no  absolute  limit  on  the 
number  and/or  amount  of  pay  increases  granted.  In  cases  where 
the  final  rating  is  "less  than  fully  successful",  corrective 
action  must  be  initiated  by  the  immediate  supervisor. 

The  involvement  of  line  managers  in  the  pay-setting 
process  has  changed  under  the  Project,  and  managers  now 
participate  in  making  initial  pay  determinations  as  well  as 
in  determining  the  amount  of  annual  pay  increase  that  is 
warranted  in  relation  to  the  employee's  performance  of  tasks 
outlined  in  the  performance  plan.  The  former  General 
Schedule  pay  scale  has  been  replaced  by  a  pay  scale  for  the 
Demonstration  Project,  consisting  of  broad  pay  bands 
encompassing  several  former  General  Schedule  grades  into  each 
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pay  band  (Exhibit  2).  These  broad  bands  are  divided  into 
increments,  which  replace  the  ten  steps  found  in  each  General 
Schedule  pay  grade. 

A  new  position  classification  system  was  designed  to 
coincide  with  the  new  pay  bands  included  in  the  Demonstration 
pay  scale.  This  new  system  incorporates  a  dual  ladder 
concept,  which  permits  advancement  to  a  higher  level  without 
assumption  of  supervisory  duties.  Each  classification 
standard  for  a  particular  level  includes  "menu  items"  based 
on  material  contained  in  the  traditional  OPM  classification 
standards  for  those  GS  grades  encompassed  in  that  level.  All 
menu  items  are  contained  in  a  computerized  program  designed 
to  prepare  position  descriptions.  This  process  makes 
possible  the  preparation  of  position  descriptions  by 
reference  to  a  handbook  containing  the  various  level 
standards  for  the  major  occupational  groups:  Scientist/ 
Engineer;  Administrative  Specialist;  Technical  Specialist; 
and,  Technician.  The  procedure  for  preparing  position 
descriptions  has  changed  from  what  was  previously  a  rigorous 
writing  exercise  to  a  process  of  "coding"  a  position 
description  based  on  selection  of  relevant  menu  items  from  a 
computerized  list  of  alternatives  (Exhibit  3).  This  coding 
results  in  the  printing  of  a  personalized  description  of 
duties,  responsibilities,  and  qualifications  required  to 
perform  them,  a  "Personal  Activities  and  Capabilities" 
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REQUESTED  BY 
CODE 


PAC  CODING  SHEET 


PAC  NO.:  EMPLOYEE'S  NAME: 


SUPERVISORY  POSITION 

_ YES 

NO 


SERIES:  _  TITLE: 

LEVEL :  _ 

FUNCTIONAL  CODE 

_ RESEARCH 

_ DEVELOPMENT 

_ TEST 

SPECIALTY  AREA  CODES 

_ PRIMARY 

,  OTHERS 


Exhibit  3.  PAC  Coding  Sheet 
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statement  or  PAC.  The  PAC  takes  the  place  of  the  old 
position  description. 

In  summary,  the  level  of  managerial  involvement  in  the 
personnel  management  functions  of  performance  evaluation,  pay 
and  position  classification  have  been  affected  as  a  result  of 
implementation  of  the  Demonstration  Project.  This  new  level 
of  managerial  »>articipation  is  a  critical  factor  in  the 
operation  of  the  new  systems,  and  the  primary  vehicle  for 
accomplishing  the  objectives  of  the  Demonstration  Project. 
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1 1 .  LITERATURE  REVIEW 


In  order  to  acquire  a  greater  appreciation  for  the 
conceptual  framework  of  the  Demonstration  Project,  a  review 
of  current  literature  was  conducted.  The  specific  focus  of 
this  review  concentrated  on  the  topics  of  performance 
evaluation  and  performance-based  pay.  Only  a  selected 
portion  of  the  literature  which  was  examined  is  cited  by 
reference  in  this  chapter.  Other  references  not  specifically 
cited  are  contained  in  the  Bibliography,  for  those  readers 
who  wish  to  explore  these  topics  in  greater  depth. 

A.  RELEVANT  THEORIES 

The  task  of  evaluating  performance  of  professional 
employees  is  especially  a  difficult  one.  Newman  and  Hinrichs 
[Ref.  4]  point  out  that  professional  employees  are  "the 
gatekeepers  of  important  information,  the  designers  of  new 
products  and  systems,  the  drivers  of  productivity."  These 
authors  see  performance  evaluation  as  an  essential  means  of 
providing  recognition  and  demonstrating  support  for  effective 
performance,  without  which  it  would  be  difficult  to  motivate 
professionals  or  to  attract  and  retain  them.  The  process  of 
performance  evaluation  for  professionals  depends  to  a  great 
extent  upon  the  supervisors  of  these  employees.  Supervisory 
feedback  is  crucial  to  the  success  of  such  a  process,  for  the 
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work  itself  is  generally  difficult  to  measure  and  provides 
only  limited  feedback.  In  order  to  assist  supervisors  in 
accomplishing  the  evaluation  task,  an  appraisal  system  that 
is  relevant  to  the  performance  which  is  being  evaluated  and 
that  is  workable  and  acceptable  to  both  supervisors  and 
employees  is  required. 

In  1977,  the  United  States  Civil  Service  Commission 
published  a  handbook  designed  to  assist  managers  in  the  task 
of  performance  evaluation  [Ref.  5].  This  handbook  listed 
some  characteristics  of  effective  performance  evaluation 
programs,  which  included  the  following: 

-  Performance  is  measured  against  written  standards  which 
are  communicated  to  the  employee. 

-  Instruments  for  performance  appraisal  are  easy  to 
understand  and  use. 

-  Employees  are  notified,  preferably  orally  and  in  writing, 
of  their  performance  ratings. 

-  The  process  does  not  attempt  to  satisfy  all  purposes  of 
evaluation  in  a  single  annual  discussion,  but  provides 
other  opportunities  for  supervisors  and  employees  to 
discuss  and  plan  performance. 

The  handbook  also  discusses  various  methods  for  developing 
performance  evaluation  standards.  In  a  section  on 
"participative  methods",  the  handbook  concludes  that 
"employee  involvement  in  work  planning,  and  development  of 
performance  standards  and  appraisals  promotes  fairer,  more 
objective  performance  appraisal  and  results  in  improved  work 
performance  and  motivation"  [Ref.  5].  For  jobs  in  which  work 
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outputs  are  difficult  to  quantify,  performance  goals  may  be 
developed  jointly  between  employees  and  their  supervisors. 
This  approach  is  characteristic  of  the  "Management  by 
Objectives"  (MBO)  process  [Ref.  6],  but  MBO  does  not  include 
methods  for  establishing  individual  performance  standards. 
Nevertheless,  MBO  techniques  are  useful  for  obtaining 
agreement  between  employees  and  their  supervisors  concerning 
the  level  of  contribution  expected  toward  task 
accomplishment.  Experience  with  participative  approaches 
suggests  that  these  methods  work  best  when  applied  to 
managerial  and  professional  jobs. 

Latham  and  Wexley  [Ref.  7]  presented  the  results  of  a 
case  study  concerning  motivation  of  Scientific  and 
Engineering  personnel  in  an  international  research  and 
development  corporation.  Their  conclusions  were  in  support 
of  participative  goal-setting,  noting  that  participation 
actually  caused  higher  goals  to  be  set  than  the  manger  would 
ordinarily  have  assigned  to  employees.  More  difficult  goals 
corresponded  positively  to  increased  effort. 

Concerning  the  linkage  between  pay  and  performance, 
Lawler  [Ref.  8]  cites  four  reasons  for  basing  pay  on 
performance : 

1.  It  has  potential  for  motivating  effective 
performance; 

2.  Achievement-oriented  people  tend  to  be  attracted  to 
organizations  that  base  rewards  on  competency; 
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3.  High  performers  expect  to  be  paid  more  than  low 
performers ; 

4.  People  are  more  satisfied  when  they  perceive  that 
they  are  paid  in  proportion  to  their  efforts. 

This  author  also  presents  evidence  to  show  that  people  will 
make  a  positive  contribution  to  the  success  of  any  new 
performance-based  pay  system  if  they  are  allowed  to  partici¬ 
pate  in  the  syste,m  design.  Such  participation  fosters  a  cli¬ 
mate  of  trust  and  openness  between  management  and  employees. 
The  organizational  climate  can  be  a  crucial  factor  in  deter¬ 
mining  the  success  or  failure  of  a  new  pay  system.  Lawler 
concludes  this  discussion  by  expressing  concern  about  the 
prospects  for  success  of  the  Merit  Pay  System  because  it 
forces  a  radical  change  from  an  existing  organizational  cli¬ 
mate  which  is  non-evalua'tive  in  nature.  Lawler  warns  that  we 
cannot  depend  upon  a  pay  system  change  to  facilitate  organi¬ 
zational  change.  If  people  perceive  that  they  may  suffer 
under  the  new  pay  system,  they  will  resist  the  change. 

B.  ALTERNATE  APPROACHES  TO  PERFORMANCE  EVALUATION 

One  aspect  of  the  Demonstration  Project  which  can  be 
compared  to  other  existing  approaches  is  the  performance 
evaluation  process.  While  the  Naval  Weapons  Center  and  the 
Naval  Ocean  Systems  Center  are  experimenting  with  their  new 
performance  appraisal  procedures,  the  rest  of  the  Navy  has 
implemented  the  Merit  Pay  System  in  July,  1980.  Like  the 
Demonstration  Project,  the  Merit  Pay  System  for  performance 
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evaluation  begins  the  process  with  the  defining  of  goals, 
setting  of  objectives,  writing  out  these  objectives,  and 
discussion  between  the  supervisor  and  the  subordinate.  An 
annual  appraisal  is  prepared  by  the  immediate  supervisor,  and 
reviewed  by  the  second  level  supervisor  as  well  as  a  Merit 

Pay  Review  Officer  [Ref.  9].  So  far  the  processes  are  very 

» 

similar . 

The  next  step  in  the  cycle  is  the  allocation  of  merit  pay 
funds.  A  pay  pool  limit  is  set  by  the  Secretary  of  the  Navy 
based  on  guidance  received  from  OPM.  By  a  simple 
calculation,  the  "pot"  is  divided  up  between  Merit  Pay 
members  eligible  for  a  pay  increase  based  on  the  final 
evaluation  of  their  performance  for  that  year.  The  amount  of 
the  actual  pay  raise  is  not,  therefore,  strictly  a  function 
of  an  individual's  performance  but  is  affected  by  the  amount 
of  available  funds.  A  recent  Merit  Pay  pool  was  limited  to 
less  than  2%  of  the  total  Navy  managerial  payroll.  The  end 
result  of  this  process  is  not  pay  for  performance,  but  rather 
resembles  rationing  of  a  limited  resource. 

In  1972,  another  Demonstration  Project  was  developed  by  a 
team  of  faculty  from  the  Naval  Postgraduate  School  in 
response  to  a  request  from  the  Office  of  the  Chief  of  Naval 
Material  [Ref.  10].  This  project  involved  the  concept  of 
"peer  ratings",  and  was  targeted  for  employees  at  the  Naval 
Supply  Center  (NSC)  and  the  Navy  Regional  Finance  Center 
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(NRFC)  ,  San  Diego.  This  project  was  implemented  at  NSC  and 
NRFC  by  direction  from  higher  headquarters  in  Washington,  and 
although  first-line  managers  seemed  to  like  it  there  was 
resistance  and  lack  of  support  at  the  higher  management 
levels  at  NSC  and  NRFC  which  caused  the  project  to  terminate 
after  only  one  year  in  operation. 

Peer  ratings  seemed  to  be  well  accepted  by  the  employees 
at  NSC  and  NRFC,  and  although  the  project  itself  did  not 
operate  long  enough  to  generate  detailed  performance  data  it 
was  successful  in  concept.  It  should  be  noted,  however,  that 
the  levels  and  types  of  employees  participating  in  that 
project  were  different  from  those  participating  in  the  Merit 
Pay  System.  Their  jobs  were  more  precise  in  nature, 
involving  accounting  functions,  which  contributed  to  greater 
similarity  between  groups  of  jobs  and  greater  understanding 
among  employees  of  the  work  being  performed  by  their  co¬ 
workers.  This  made  the  task  of  judging  a  co-worker's 
performance  quite  a  bit  simpler  due  to  the  homogeneous  nature 
of  the  work  itself. 

This  project  at  NSC  and  NRFC  provides  an  example  of  the 
need  for  management  support  to  contribute  to  the  continuing 
success  of  an  organizational  change.  Even  though  it  was 
apparently  successful  in  concept,  this  project  failed  due  to 
the  lack  of  management  support. 
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Looking  at  the  private  sector,  a  type  of  "Consensus 
Ranking"  is  currently  being  used  at  the  Kaiser  Aluminum  and 
Chemical  Corporation  [Ref.  11].  Called  the  Objective 
Judgment  Quotient  (OJQ),  this  system  leads  to  a  forced 
numerical  ranking  for  a  set  of  employees.  Employees  are 
compared  both  to  one  another,  as  well  as  to  benchmark 
standards  characteristic  of  their  occupational  group.  The 
intent  of  the  OJQ  is  to  minimize  rater  bias  in  a  process 
which  normally  tends  to  be  highly  subjective.  The  OJQ  is 
being  used  on  an  experimental  basis  at  Kaiser  at  this  time. 

Also  at  Kaiser,  a  merit  pay  pool  is  established  subject 
to  budgetary  constraints  and  prescribed  target  percentages  of 
ratings  to  be  given  in  each  of  four  performance  categories. 
Employees  receiving  marginal  performance  ratings  are  given  a 
9 0 -day  probationar y  notice,  and  could  be  terminated  for 
failure  to  improve  during  probation.  Goals,  objectives,  and 
specific  performance  criteria  are  developed  and  discussed 
with  employees  by  their  supervisors.  Appraisals  are 
accomplished  every  six  months,  and  the  length  of  the  total 
rating  period  may  vary  between  nine  and  fifteen  months  based 
on  the  discretion  of  the  supervisor.  This  allows  the  best 
performers  to  receive  pay  raises  as  often  as  every  nine 
months,  and  marginal  performers  are  required  to  wait  longer. 
Kaizer  also  offers  a  comprehensive  benefits  package  for 
senior  managers  and  executives,  which  includes  bonus  and 
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stock  options.  The  payout  for  performance-related  pay 
increases  alone  at  Kaiser  is  currently  amounting  to  8-9%  of 
the  total  payroll. 

In  summary,  it  becomes  clear  that  there  are  many  operable 
variations  of  performance-based  evaluation  systems  in  both 
the  public  and  private  sectors.  Some  key  factors  that  appear 
to  contribute  to  the  success  or  failure  of  these  approaches 
are  that  the  organization  rewards  performance  in  an  equitable 
manner;  that  there  is  a  clear  relationship  between  good 
performance  and  rewards,  and  the  relationship  is  clearly 
understood  by  employees;  that  management  supports  the 
performance  evaluation  system  and  administers  it  as  intended; 
and,  that  the  amount  of  the  financial  incentives  offered  is 
large  enough  so  that  employees  receiving  a  pay  raise 
recognize  that  they  have  in  fact  been  rewarded. 

C.  DISCUSSION 

In  consideration  of  relevant  conceptual  theories  and  the 
needs  of  Navy  laboratories  to  attract  and  retain  high  quality 
professionals,  the  proposal  for  the  Demonstration  Project  was 
formulated.  The  performance  evaluation  system  was  designed 
specifically  to  appraise  the  performance  of  professionals,  by 
increasing  the  requirement  for  communications  and  feedback 
between  employees  and  supervisors  and  requiring  discussion  of 
performance  expectations.  Guidelines  issued  by  OPM  and  the 
CSRA  were  closely  adhered  to  while  making  maximum  use  of  the 
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flexibility  permitted  by  the  Act  in  order  to  streamline  the 
position  classification  and  pay  systems.  The  intent  of 
involving  employees  in  the  development  of  the  new  systems 
that  would  ultimately  affect  them  under  the  Project  was  to 
foster  and  enhance  an  organizational  climate  that  would  be 
conducive  to  accept  the  changes. 

This  approach  makes  sense  in  view  of  the  theoretical 
framework  previously  presented.  It  is  recognized,  however, 
that  procedures  alone  cannot  enforce  or  ensure  that 
meaningful  communication  takes  place.  Likewise,  the 
invention  of  new  position  classification  and  pay  systems 
cannot  ensure  that  the  users  of  these  systems  will  believe 
that  all  problems  have  been  solved  by  the  creation  of  these 
new  systems  alone. 

The  real  determining  factor  that  is  crucial  to  the 
success  of  any  organizational  change  is  the  climate  of  the 
organization.  One  facet  of  that  climate  is  managerial 
response  to  planned  change.  Thus,  the  examination  of 
managerial  attitudes  and  opinions  will  give  us  some  useful 
insights  into  assessing  the  level  of  acceptance  of  a  planned 
organizational  change,  a  Demonstration  Project,  and  toward 
predicting  the  likelihood  of  success  for  this  change  based  on 
the  degree  to  which  it  meets  the  needs  of  managers  and 
facilitates  efficient  performance  of  their  work. 
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III.  NATURE  OF  THE  PROBLEM 


Prior  research  concerning  the  Demonstration  Project  has 
been  conducted  by  a  team  at  the  University  of  Southern 
California,  by  the  firm  of  Coopers  and  Lybrand,  by  the  Office 
of  Personnel  Management  (OPM),  and  by  Internal  Evaluation 
Teams  at  both  the  Naval  Weapons  Center  and  the  Naval  Ocean 
Systems  Center.  Various  studies  have  been  published  by  the 
evaluators  [Refs.  12,  13  and  14];  however,  none  of  these 
studies  have  focused  specifically  on  the  managerial 
population  affected  by  the  Project.  OPM  officials  have 
recently  determined  that  the  evaluation  effort  must  include 
data  about  managerial  participation. 

While  it  is  possible  to  break-out  some  of  the  existing 
data  in  terms  of  the  level. and  supervisory  status  of  the 
respondents,  the  overall  orientation  of  this  data  is  toward 
the  impact  of  the  Project  on  employees.  The  existing  data 
does  not  examine  the  Project  in  detail  from  a  managerial 
perspective.  Thus,  the  need  arose  to  develop  a  means  for 
collecting  managerial  data  in  order  to  produce  an  evaluation 
of  the  total  Demonstration  Project. 

The  research  problem  is  further  complicated  by  the  lack 
of  a  true  experimental  control  group.  Even  though  two 
control  laboratories  were  designated  by  OPM,  these  labs  no 
longer  operate  under  the  same  performance  evaluation  and  pay 
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systems  that  existed  prior  to  the  Civil  Service  Reform  Act 
(CSRA).  Since  the  Demonstration  Project  was  implemented 
immediately  after  leaving  the  pre-CSRA  systems,  the  only 
available  baseline  data  is  that  which  was  collected  about  the 
pre-CSRA  systems. 

An  alternative  is  to  compare  managerial  baseline  data 
with  current  data.  Since  it  was  not  known  by  the  evaluators 
at  the  inception  of  the  Project  that  a  specific  area  of 
interest  would  be  managerial  involvement,  very  little  pre- 
CSRA  data  is  available  in  terms  of  the  managerial 
perspective.  A  true  experiment  is,  therefore,  not  possible. 

The  only  remaining  alternative  is  to  address  the  problem 
through  the  means  of  a  survey,  which  eliminates  the  need  for 
an  experimental  control  group  but  still  affords  a  way  to 
collect  and  analyze  meaningful  data  [Ref.  15]. 

The  research  question  to  be  addressed  by  the  survey 
method  is  to  determine  the  impact  of  the  CSRA  Demonstration 
Project  on  managers  at  the  Naval  Weapons  Center.  Only  the 
survey  results  from  China  Lake  will  be  presented  and  analyzed 
in  this  paper.  A  total  of  3,900  civilians  are  employed  at 
China  Lake,  of  which  475  are  managers  participating  in  the 
Project.  Other  managers  are  employed  at  China  Lake;  however, 
they  did  not  receive  the  survey  because  they  are  not 
participating  in  the  Project. 
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Since  the  specific  area  of  concern  to  managers  prior  to 
the  Project  was  the  inflexibility  of  the  total  system  for 
personnel  management  with  regard  to  meeting  managerial  needs, 
the  survey  must  explore  this  concern  in  detail.  Data  about 
managerial  time  spent  on  personnel  management  functions,  and 
the  by-products  of  the  classification  and  performance 
evaluation  processes  (namely  the  position  descriptions  and 
performance  plans)  must  be  collected  for  both  the  pre-CSRA 
and  Demonstration  Project  Systems.  Managerial  time  is 
considered  to  be  a  valid  indicator  of  efficiency  not  in  terms 
of  increases  or  decreases  in  the  amounts  of  time  spend  on 
management  tasks  alone,  but  also  in  terms  of  the  quality  of 
the  time  spent  and  its  overall  contribution  to  productive 
output. 

In  view  of  the  fact  that  very  little  pre-CSRA  data  was 

available  from  the  managerial  population  specifically 

pertaining  to  personnel  management  functions,  it  became 

necessary  to  attempt  to  reconstruct  the  necessary  pre-CSRA 

-f 

data  based  on  memory.  It  is,  therefore,  recognized  that  the 
accuracy  of  the  data  about  the  pre-CSRA  system  will  be 
affected.  Nevertheless,  this  data  is  needed  in  order  to  make 
some  comparisons  between  managerial  experience  under  the  old 
and  new  systems. 
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IV.  THE  RESEARCH  METHOD 


In  order  to  answer  the  research  question  to  determine  the 
impact  of  the  Demonstration  Project  on  managers  at  the  Naval 
Weapons  Center,  an  instrument  would  be  needed  to  collect  data 
from  managers.  Data  would  be  needed  about  both  the  pre-CSRA 
systems  for  position  classification,  pay,  and  performance 
evaluation,  and  the  Demonstration  Project  Systems  for  the 
same  functions  in  order  to  test  hypotheses.  This  data  would 
need  to  focus  on  managerial  time  spent  on  these  functions  and 
the  results  of  their  efforts  in  order  to  assess  and  compare 
the  efficiency  of  the  old  and  new  systems. 

A.  HYPOTHESES 

The  first  hypothesis  to  be  tested  is  that  managers  who 
supervised  employees  under  the  old  system  will  find  the  new 
system  to  be  an  improvement.  The  reason  for  this  assumption 
is  that  one  of  the  major  complaints  .rom  managers  about  the 
pre-CSRA  system  was  that  it  was  not  responsive  to  their 
needs.  The  new  system  was  deliberately  designed  to  increase 
responsiveness  by  allowing  greater  participation  in,  and 
therefore,  control  of,  system  response  to  better  meet  the 
needs  of  line  management. 

The  second  hypothesis  is  that  there  will  be  no  difference 
between  the  major  occupational  groups  of  managers  in  terms  of 
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preference  for  the  Demonstration  Project.  This  assumption  is 
based  on  the  fact  that  managers  and  employees  from  each  major 
occupational  group  were  instrumental  in  designing  the  new 
systems  for  the  Project  with  regard  to  their  respective 
group.  This  is  because  separate  Task  Teams  for  each  of  the 
major  occupational  groups  were  established  to  develop  the 
implementation  plans  for  those  systems  that  would  affect 
them. 

A  third  hypothesis  to  be  tested  is  that  managers  will 
respond  that  they  are  able  to  make  other,  more  productive  use 
of  their  time  under  the  Project  than  was  possible  under  the 
old  system.  The  basis  for  this  assumption  is  that  the 
streamlining  of  the  classification  process  would  free  up  more 
of  their  time  which  could  be  spent  on  more  productive 
activities . 

The  fourth  hypothesis  is  that  the  number  of  PACs 
considered  by  managers  as  accurate  would  be  greater  than  the 
number  of  position  descriptions  that  were  considered  accurate 
under  the  old  system.  This  response  would  be  attributable  to 
the  relative  ease  of  preparing  and  obtaining  classification 
of  PACs  versus  the  problems  associated  with  the 
classification  of  position  descriptions  under  the  old  system. 

A  fifth  hypothesis  is  that  the  relative  usefulness  of 
PACs  will  be  seen  as  greater  than  the  usefulness  of  position 
descriptions.  This  ties  into  the  previous  rationale  for 
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greater  accuracy  of  PACs  as  compared  to  position 
descriptions,  and  this  higher  accuracy  should  lead  to 
increased  relevance  of  PACs  over  position  descriptions. 

The  final  hypothesis  is  that  the  new  performance 
evaluation  system  under  the  Demonstration  Project  will  be 
viewed  as  more  beneficial  to  managers  than  the  old  pre-CSRA 
system.  This  assumption  is  based  on  the  direct  relationship 
in  the  new  system  between  mission  accomplishment  and  the 
planning  process  in  which  performance  expectations  are 
clearly  identified  in  writing  and  communicated  to  employees. 

B .  SURVEY  DEVELOPMENT 

The  first  step  in  conducting  this  research  was  to  design 
a  survey  instrument  to  collect  managerial  data.  Formulation 
of  a  questionnaire  began  at  The  Naval  Ocean  Systems  Center, 
San  Diego  with  a  group  of  per sonnelists.  Inputs  to  the  ques¬ 
tionnaire  were  obtained  from  operating  personnel  office  staff 
members  based  on  questions  and  concerns  that  were  frequently 
raised  by  line  managers.  Some  personnelists  who  have  given 
briefings  on  the  Demonstration  Project  provided  inputs  based 
on  questions  more  frequently  asked  in  these  briefings. 

The  format  and  organization  of  the  questionnaire  was 
intended  to  permit  collection  of  data  about  managerial  expe¬ 
riences  under  the  pre-CSRA  system,  followed  by  data  about  the 
Project,  on  similar  variables.  This  type  of  design  would 
facilitate  the  testing  of  hypotheses  regarding  the  impact  of 
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changes  experienced  by  managers  under  the  new  system. 
Comparative  data  would  be  easier  to  obtain  about  the  classi¬ 
fication  process  than  about  performance  planning  and 
evaluation,  primarily  because  of  the  lack  of  mechanisms  for 
performance  planning  and  monitoring  in  existence  under  the 
pre-CSRA  system.  For  this  reason,  the  major  source  of  data 
about  performance  evaluation  would  be  attitudinal  rather  than 
quantitative . 

The  first  draft  of  the  questionnaire  was  forwarded  to  NWC 
China  Lake  to  be  evaluated  by  the  members  of  the  Internal 
Evaluation  Task  Team  and  pe r sonnel is ts .  After  providing 
their  inputs,  the  Task  Team  members  took  a  pretest  of  the 
revised  questionnaire. 

The  approved  version  of  the  questionnaire  (Appendix  A) 
was  distributed  at  China  Lake  on  10  March  1983  to  the  total 
population  of  475  managers.  At  the  time  that  the  deadline 
for  return  of  questionnaires  was  reached  on  1  April  1983,  a 
total  of  265  questionnaires  had  been  returned  for  a  56% 
response  rate.  Nine  questionnaires  were  received  after  the 
deadline,  making  the  total  response  rate  58%;  however,  these 
late  arrivals  were  not  received  in  time  to  be  included  in 
this  analysis. 

C.  CONTENT  ANALYSIS  PROCEDURE 

Completed  answer  sheets  for  the  sample  of  265  cases  were 
read  by  an  optical  scanner  and  recorded  on  magnetic  tape. 
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Two  of  the  cases  were  not  readable  by  the  scanner,  which 
reduced  the  sample  size  to  263  cases.  A  program  was 
developed  using  the  Statistical  Package  for  the  Social 
Sciences  (SPSS)  to  analyze  the  data.  The  Frequencies 
procedure  was  used  to  generate  tables  for  each  of  the  survey 
questions.  Contingency  tables  were  then  produced  for  the  key 
variables  to  be  analyzed  in  order  to  test  hypotheses,  using 
the  Crosstabs  procedure.  Each  variable  is  identified  in  the 
tables  found  in  Appendix  B,  and  all  variables  are  listed  in 
the  indices  contained  at  the  end  of  that  Appendix. 

Following  the  SPSS  analysis,  a  cost-effectiveness  model 
was  developed.  The  model  utilized  the  criterion  of  maximum 
effectiveness/cost  ratio.  The  following  equations  are 
included  in  the  model: 

Cost  =  Supervisory  Manhours  x  Supervisory  Salary 
Effectiveness  =  f  (variable  list) 

The  variables  selected  for  use  in  the  effectiveness 
equation  were  chosen  on  the  basis  of  their  perceived 
contribution  to  the  overall  accomplishment  of  a  manager's 
job.  The  model  was  used  to  compare  estimated  costs  and 
effects  for  the  pre-CSRA  systems  with  the  costs  and  effects 
under  the  Project.  Tables  3-1  and  3-2  present  the  cost  and 
effectiveness  data,  respectively. 
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V.  SURVEY  RESULTS  AND  DISCUSSION 


Appendix  B  contains  the  tables  produced  by  computer 
output  as  a  result  of  an  analysis  of  the  survey  data,  using 
the  Statistical  Package  for  the  Social  Sciences  (SPSS). 
Tables  which  give  the  frequency  distribution  on  responses  to 
each  question  contained  in  the  questionnaire  are  presented, 
preceded  by  seven  contingency  tables  generated  to  test 
hypotheses.  Some  highlights  of  the  results  are  presented  in 
this  chapter. 

Tables  numbered  1  through  4  present  demographic  data 
about  the  respondents.  Managers  classified  as  scientists  and 
engineers  comprised  68%  of  the  respondents?  administrative 
specialists  accounted  for  19%  of  the  sample;  technical 
specialists  comprised  5%  of  the  respondents?  and,  9%  were 
technicians.  The  mean  salary  for  all  Project  supervisory 
personnel  was  $43,632  per  annum.  Approximately  69%  of  the 
respondents  were  first  line  supervisors.  Eighty  percent  of 
these  managers  were  in  supervisory  positions  at  the  time  the 
Demonstration  Project  was  implemented  for  their  occupational 
group.  The  other  20%  became  supervisors  under  the  new 
system,  which  in  most  cases  indicates  the  absence  of 
supervisory  experience  under  the  old  system.  Ninety-three 
percent  of  all  Project  supervisors  have  over  ten  years  of 
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Federal  service,  and  54%  have  over  twenty  years.  The 
demographic  data  contained  in  these  tables  was  supplemented 
by  information  from  the  personnel  database. 

Table  5  indicates  that  61%  of  the  supervisors  responded 
that  they  were  the  usual  author  of  General  Schedule  position 
descriptions  for  their  subordinates.  Forty-eight  percent 
reported  that  they  wrote  one  to  three  position  descriptions 
per  year  under  the  old  system,  while  22%  wrote  between  four 
and  ten  per  year  as  noted  in  Table  22.  Table  24  illustrates 
that  32%  of  the  managers  estimated  that  up  to  10%  of  all 
position  descriptions  in  their  organization  were  inaccurate, 
and  22%  recalled  the  percentage  of  inaccurate  descriptions  to 
be  between  11  and  25%.  The  major  reason  noted  for  not 
updating  more  of  these  inaccurate  descriptions  wa  that 
accuracy  was  not  considered  important  under  the  old  system  by 
46%  of  the  supervisors  (Table  26).  Seventy  percent  recalled 
that  they  used  each  position  description  not  more  than  twice 
per  year  in  Table  27.  The  major  uses  noted  in  Tables  28 
through  31  in  order  of  importance  were  for  performance 
appraisal,  required  reviews,  recruitment,  and  promotion. 

Table  6  illustrates  that  58%  of  the  managers  responding 
indicated  that  they  were  the  usual  author  of  Personal 
Activities  and  Capability  Statements  (PACs)  written  for  their 
employees.  Tables  35  through  38  show  that  only  a  very  small 
percentage  of  PACs  took  more  than  three  hours  to  prepare, 
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while  the  majority  took  less  than  one  hour  each.  Ninety- 
three  percent  of  the  respondents  felt  that  10%  or  less  of  all 
PACs  were  inaccurate  (Table  50).  The  major  uses  for  PACs 
illustrated  in  Tables  52  through  55  in  order  of  importance 
were  performance  appraisal,  required  reviews,  promotion, 
instructing  employees,  and  recruitment. 

Ninety-one  percent  of  all  respondents  in  Table  58  replied 
that  the  position  classification  process  is  simplified  under 
the  Demonstration  Project.  Ninety-one  percent  also  felt  that 
the  classification  process  takes  less  time  under  the  Project 
(Table  59).  Sixty-five  percent  responded  that  classification 
is  better  understood  under  the  Project  in  Table  66.  Seventy- 
eight  percent  of  the  managers  responded  that  they  are  able  to 
make  other  more  productive  uses  of  their  time  now  (Table  67) . 

Tables  72  and  73  show  that  a  majority  of  managers  spend  a 
decreased  amount  of  time  preparing  PACs  to  be  classified,  and 
negotiating  about  their  classification  with  Personnel 
specialists.  Sixty-eight  percent  felt  that  they  are  spending 
more  time  now  on  performance  planning  (Table  74).  Perfor¬ 
mance  reviews  and  monitoring  are  on  the  increase  according  to 
77%  in  Table  76.  Pay  decisions,  aware  recommendations  and 
Performance  Review  Boards  use  up  more  time  now  according  to 
64%  of  the  respondents  in  Table  77.  The  majority  of  other 
supervisory  functions  relating  to  personnel  management  are 
reported  as  unchanged  by  the  Project. 


41 


Seventy-six  percent  of  the  managers  responding  in  Table 
79  felt  that  the  overall  net  change  of  the  Demonstration 
Project  is  an  improvement  over  the  old  system.  The 
contribution  of  performance  planning  to  mission 
accomplishment  is  reported  as  greater  under  the  Project  by 
62%  of  the  respondents  in  Table  80.  Setting  of  objectives, 
monitoring  of  performance,  and  annual  performance  ratings  are 
viewed  as  beneficial  by  over  85%  of  the  respondents  in  Tables 
81,  82  and  83.  Fifty-nine  percent  view  the  linkage  between 
performance  evaluation  and  pay  as  beneficial  (Table  85). 
Communication  of  performance  expectations  is  up  for  62%  in 
Table  88,  and  66%  feel  that  employees  know  more  about  what's 
expected  of  them  now  in  Table  89.  Over  70%  responded  that 
performance  plans  help  to  identify  employee  training  needs, 
and  to  deal  with  performance  problems  in  Tables  96  and  97. 

Table  99  reports  that  77%  of  the  managers  responded  that 
the  Demonstration  Project  is  seen  as  beneficial  to  their 
overall  supervisory  performance.  Table  100  concludes  the 
questionnaire  results  with  78%  of  the  respondents  stating 
their  preference  for  the  Project. 

In  relation  to  the  specific  hypotheses  listed  in  Chapter 
IV,  the  contingency  tables  located  at  the  front  of  Appendix  B 
confirm  hypotheses  one,  three,  four,  and  six.  These  null 
hypotheses  are  as  follows: 
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:  Those  respondents  who  were  supervisors  at  the  time  of 

entry  into  the  Project  found  the  new  system  to  be  an 
improvement. 

H3 :  Managers  feel  that  they  are  making  other,  more 

productive  use  of  their  time  now. 

H4:  PACs  are  more  accurate  than  position  descriptions  were 

under  the  old  system. 

Hg :  The  Project  performance  evaluation  process  makes  a 

greater  contribution  to  mission  accomplishment  than 
the  old  system. 

Hypotheses  two  and  five  were  disproved  by  the  analysis. 
The  following  alternate  hypotheses  were  proven: 

H2a:  There  is  a  difference  between  the  level  of 
satisfaction  with  the  Demonstration  Project  for  the 
major  occupational  groups. 

H5A:  PACs  are  not  considered  to  be  more  useful  than 
position  descriptions. 

Scientists/Engineers  and  Administrative  Specialists 
reported  a  higher  satisfaction  rate  with  the  Project  than  did 
Technical  Specialists  and  Technicians.  It  should  be  noted 
that  there  is  a  high  correlation  between  the  two  groups 
comprising  a  majority  of  the  Project  participants  and  the 
higher  satisfaction  rate. 

Regarding  the  relative  usefulness  of  PACs,  the  majority 
of  the  respondents  indicated  no  improvement  over  the 
usefulness  of  position  descriptions  under  the  old  system. 
This  tends  to  negate  the  importance  of  increased  accuracy  of 
PACs. 

The  overall  results  of  the  managerial  survey  have  been  in 
favor  of  the  Demonstration  Project.  While  some  improvements 


were  reported  in  the  total  position  classification  process, 
the  end  result  of  that  process  {PAC)  was  not  found  to  be  any 
more  useful  than  its  predecessor;  however,  the  performance 
planning  process  was  viewed  as  very  beneficial  in  several  key 
areas  of  importance  to  managers.  Mission  accomplishment  is 
enhanced,  communications  are  increased,  and  the  plans  are  a 
useful  tool  for  identifying  training  needs  and  handling 
employee  performance  problems. 

Several  constructive  suggestions  were  provided  by  the 
respondents  as  an  addendum  to  the  survey  data.  Some  managers 
recoru.uended  chat  the  decision  to  award  a  pay  raise  should  be 
made  without  the  constraint  of  a  pay  guideline.  Others 
question  the  value  of  awarding  pay  raises  solely  in 
recognition  of  performance.  A  need  arises  for  some  mechanism 
to  protect  the  equity  of  salaries  for  current  employees 
against  the  higher  entry  level  salaries  that  are  offered  to 
new  hires.  Some  suggestions  came  out  in  favor  of  avoiding 
further  attempts  to  regulate  the  pay  system  with  the  addition 
of  midpoint  constraints.  These  issues  warrant  further 
attention  by  the  Task  Teams,  Steering  Committee,  and  internal 
evaluators. 


VI.  CONCLUSIONS 


This  paper  has  presented  a  broad  overview  of  the 
conceptual  framework  for  a  Demonstration  Project.  The 
current  literature  was  researched  and  selected  relevant 
theories  were  presented.  Examples  of  other  approaches  to  the 
practice  of  performance  evaluation  were  presented  and 
described.  Through  the  development,  administration,  and 
analysis  of  survey  data  specific  hypotheses  were  tested  and 
attitudinal  information  was  collected  about  the  impact  of 
this  Project  on  managers  at  the  Naval  Weapons  Center. 

In  this  concluding  chapter,  the  results  of  this  study  are 
reviewed  so  that  it  may  serve  as  an  executive  summary  for 
readers  interested  in  a  recapitulation  of  the  highlights  of 
the  study.  For  a  complete  breakdown  of  the  survey  data. 
Appendix  B  should  be  examined. 

Much  of  the  current  literature  presents  evidence  in 
support  of  a  participative  approach  to  the  design, 
development  and  administration  of  performance  evaluation  and 
pay  systems.  Communication  is  stressed  as  an  important 
ingredient  to  the  success  of  such  an  approach.  Equity  is 
also  considered  to  be  a  key  variable  to  the  successful 
operation  of  performance-based  pay  systems.  A  high  level  of 
trust  is  needed  between  employees  and  management  in  order  for 
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performance-based  rewards  and  significant  changes  in  pay 
administration  to  be  accepted.  A  clear  relationship  between 
performance  standards  and  behavior  that  is  rewarded  is 
essential  to  that  acceptance.  The  use  of  a  participative 
approach,  therefore,  is  not  in  itself  a  guarantee  of  success. 

The  survey  results  from  China  Lake  show  that,  overall, 
managers  prefer  the  Demonstration  Project  to  the  pre-CSRA 
approach  to  personnel  management;  however,  there  are  some 
specific  areas  of  concern  that  evidence  the  need  for  further 
attention.  Acceptance  of  the  Project  is  not  equal  among  the 
major  occupational  groups.  Scientist/Engineers  and 
Administrative  Specialists  are  more  satisfied  with  the 
Project  than  are  Technical  Specialists  and  Technicians.  This 
may  be  indicative  of  a  need  to  reexamine  the  specific 
concerns  of  those  groups  which  are  less  satisfied. 

PACs  are  more  accurate  than  position  descriptions  but  not 
considered  to  be  any  more  useful.  There  appears  to  be  very 
little  recognition  of  any  relationship  between  a  PAC  and  a 
performance  plan,  which  contains  specific  expectations  about 
how  the  job  is  to  be  done.  Also,  PACs  are  not  used  any  more 
frequently  than  position  descriptions,  and  the  major  reasons 
for  their  use  are  the  same  as  for  PDs  with  the  exception  of 
the  addition  of  the  use  of  PACs  for  instructing  employees 
about  the  work.  Line  managers  are  still  the  usual  authors  of 
PACs,  in  the  majority  of  cases,  but  they  now  spend  less  time 
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preparing  PACs  and  getting  them  classified  than  under  the 
pre-CSRA  system. 

While  a  reduction  of  managerial  time  spent  on  position 
classification  is  evident,  the  net  change  in  time  spent  on 
personnel  management  functions  is  not  significant  due  to  an 
increase  in  time  spent  on  performance  planning,  monitoring 
and  review,  pay  and  award  decisions.  Managers  consider  the 
increased  amount  of  time  spent  on  setting  objectives, 
monitoring  performance,  and  preparing  annual  performance 
ratings  to  be  beneficial  in  accomplishing  their  supervisory 
responsibilities.  Performance  plans  are  seen  as  useful  in 
identifying  employee  training  needs  and  performance  problems. 
We  may  conclude  then  that  a  majority  of  managers  consider 
that  their  time  is  better  spent  under  the  Project  in  terms  of 
productive  outputs. 

Finally,  the  cost-effectiveness  model  illustrates 
comparisons  of  data  about  the  investments  for  managers  in 
terms  of  manhours  and  salary,  and  the  resulting  levels  of 
effectiveness  in  terms  of  their  performance  as  supervisors 
both  before  and  after  the  implementation  of  the  Project. 
Again,  it  must  be  noted  that  the  only  obtainable  data  in 
terms  of  manhours  and  effectiveness  pertains  to  the  position 
classification  function.  This  data  is  not  entirely  reliable 
based  on  the  fact  that  it  was  necessary  for  respondents  to 
recall  from  memory  their  experiences  under  the  old  system. 
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Nevertheless,  it  is  clear  that  managers  do  not  find  the 
position  classification  process  to  be  a  positive  contributor 
to  their  supervisory  performance.  Rather,  they  view  it  as  a 
task  that  must  be  done  in  order  to  recruit  and  promote 
employees  Time  saved  in  the  position  classification  process 
is  primarily  useful  to  managers  because  they  are  now  able  to 
devote  that  time  to  more  productive  activities. 

One  final  reference  that  I  would  like  to  cite  to  put  the 
results  of  this  study  into  perspective  comes  from  a  very 
recent  publication  based  on  studies  of  some  of  the  more 
successful  firms  in  the  United  States.  Peters  and  Waterman 
point  out  that  when  an  organization  fails,  that  failure  is 
seldom  attributed  to  a  lack  of  concern  for  people  o  the  part 
of  management  [Ref.  16],  The  most  successful  companies, 
however,  look  to  people  to  increase  productivity  rather  than 
to  financial  controls  or  technology.  These  firms  are 
characterized  by  a  tough  approach  to  management,  but  that 
approach  is  enforced  by  shared  expectations  and  peer  pressure 
rather  than  by  elaborate  control  systems.  No  one  particular 
approach  to  management  can  guarantee  success  indefinitely. 
Overreliance  on  systems  and  mechanisms  alone  cannot  enhance 
true  productivity. 

My  reason  for  ending  this  study  with  Peter's  and 
Waterman's  thoughts  about  productivity  is  to  reinforce  the 
importance  of  paying  attention  to  people  and  their  needs  for 


recognition.  It  would  be  very  risky  to  expect  an  elaborate 
system  such  as  this  Demonstration  Project  to  successfully 
meet  those  needs.  Such  a  system  must  be  kept  flexible  in 
order  to  be  responsive  to  the  needs  of  people,  and  to 
managers  in  particular,  for  it  cannot  ever  become  a 
substitute  for  good  judgment  about  how  to  supervise  people. 


49 


APPENDIX  A 


SAMPLE  QUESTIONNAIRE 

DEPARTMENT  OP  THE  NAVY 

NAVAL  WEAPONS  CENTER 

CHINA  LAKE.  CALIFORNIA  93555  IN  REFLV  REFER  TO 

10  Mar  1933 


MEMORANDUM 


From:  Technical  Director 

To:  Demonstration  Project  Supervisors  and  Managers 

Subj:  Evaluation  of  Demonstration  Project 

Enel:  (1)  Questionnaire  regarding  personnel  functions  performed  by 

supervisors  and  instruction  and  answer  sheets 

1.  A  critical  portion  of  the  evaluation  of  the  Demonstration  Project 
will  be  an  assessment  of  its  impact  on  supervisors'  involvement  in 
personnel  management  functions.  As  a  Demonstration  Project  Supervisor 
or  Manager,  you  are  being  asked  to  help  in  this  assessment  effort  by 
completing  the  enclosed  questionnaire.  Some  of  the  questions  ask  that 
you  estimate  times  spent  on  personnel  functions  prior  to  the  beginning 
of  the  Demonstration  Project  in  July  1980.  Although  we  realize  it  is 
very  difficult  to  reconstruct  activities  that  long  ago,  we  would  ap¬ 
preciate  your  help  in  making  estimates. 

2.  Since  this  questionnaire  (enclosure  (1))  is  being  used  at  both  NOSC 
and  NWC,  some  questions  will  be  specific  to  one  or  the  other  Center. 

This  will  be  indicated  on  the  questions.  Please  disregard  those  questions 
labeled  "NCSC  only." 

3.  The  completed  questionnaires  will  oe  processed  by  automated  equipment 
which  will  summarize  the  answers  in  statistical  form.  Your  individual 
answers  will  remain  strictly  confidential,  and  they  will  be  combined 
with  those  of  the  other  respondents.  An  optical  scanning  answer  sheet 
and  intructions  are  enclosed.  Please  return  the  answer  sheet,  along  with 
any  written  comments,  to  Code  0902  at  your  earliest  convenience  but  not 
later  than  1  April  1983. 

4.  Thank  you  for  your  cooperation  in  this  effort.  If  you  would  like  a 
summary  of  the  results  of  this  questionnaire,  please  indicate  below. 
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Instruction  Sheet  for  Answers  to  Questionnaire 


1.  The  answer  sheet.  General  Purpose-NCS-Answer  Sheet,  is  the  enclosed 
green-colored  sheet  (one  page  with  two  sides).  It  is  a  standard,  low- 
cost  scoring  sheet  compatible  with  optical  scanning  equipment  which  will 
be  used  for  tallying  the  responses. 

2.  Ignore  the  left-hand  portion  of  side  1  which  starts  with  "name". 

This  section  will  not  be  used  and  should  not  have  any  marks  placed  on 
it. 

3.  Start  by  reading  side  2  of  the  answer  sheet  which  provides  marking 
directions.  Please  use  a  No. 2  pencil  for  scoring. 

4.  Begin  marking  your  choices  from  the  questionnaire  on  side  1  of  the 
answer  sheet.  Start  with  question  1.  For  example,  if  your  answer  is 
"4"  onquestionl,  mark  column  "4"  on  the  answer  sheet  for  question  1. 

5.  If  you  want  to  add  any  written  comments,  enclose  them  on  a  seoarate 
sheet  of  paper.  Please  do  not  write  comments  on  the  green  answer  sheet 
as  they  will  interfere  with  the  optical  scan  tally. 

i 

6.  Please  return  the  answer  sheet  (do  not  fold  it)  and  any  separate 
written  comments  in  a  guard  mail  envelope  to  Code  0902.  Please  do  not 
return  the  questionnaire. 

7.  If  you  have  any  questions,  contact  Bob  Glen  (Code  0902)  at  extension 
3196  or  2434.  Thanks  for  your  cooperation  and  assistance. 


DEMO  PROJECT  SUPERVISORS'  QUESTIONNAIRE. 

This  is  a  one-time  data  gathering  effort.  Please  consider 
carefully,  and  answer  as  to  how  the  systems  were  or  are  actually 
working,  not  hew  they  should  have  been  or  should  be  working. 

See  the  enclosed  instruction  sheet  for  answering  this  question¬ 
naire. 

The  use  of  the  optical  scan  answer  sheet  has  resulted  in  a  rather 
lengthy  questionnaire;  however,  pre-testing  indicates  that  20  min¬ 
utes  should  be  sufficient  time  for  completing  the  questionnaire. 
Your  responses  are  critical  for  valid  overall  evaluation  results. 


1.  What  is  your  current  classification? 

1.  Scientist/Engineer . (1) 

2.  Administrative . .(2) 

3.  Specialist . .* . ‘  .  (3) 

4.  Technician . (4) 

2.  "What  is  your  organizational  level? 

1.  Branch  or  Unit  Head . (1) 

2.  Division  Head  or  Assoc.  Div.  Hd . (2) 

3.  Department  Head  or  Assoc.  Dept.  Hds.  .  .  .  .(3) 

4.  Director,  .Major  Staff  Office  Head  or  Above  .(4) 

5.  Head,  Program  Office . (5) 

3.  'Were  you  a  supervisor/manager  in  July  1980  when  NOSC/NWC 
entered  into  the  Demonstration  Project? 

1 .  Yes  .  .  . . ( 1 ) 

2.  No  . (2) 

4.  If  yes,  were  you 

1.  At  the  same  organizational  level . (1) 

2.  A\t  a  lower  organizational  level . (2) 


Classification  experience  prior  to  Demonstration  Project-: 

5.  In  the  organization  which  you  supervised  prior  to 
July  1980,  were  GS  position  descriptions  usua 1 ly 


drafted  or  written  by: 

1 .  Yourscl  f . ( 1 ) 

2.  A  lower  level  supervisor . (2) 

3.  A  staff  assistant . .(3) 

4.  The  employee . (4) 
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In  the  organization  which  you  supervised  prior  to  July  1983, 
about  how  many  hours  did  you  personally  spend  in  drafting, 
reviewing,  discussinq  final  preparation  of  or  negotiating  over  a 
typical  position  description  in  each  of  the  following  categories? 

G.  GS-14/15 

1 .  Less  than  4  hours . ( 1 ) 

2.  4-0  hours . (2) 

3 .  9-16  hours . ( 3  ) 

4.  More  than  1G  hours . (4) 

5.  None  done  at  this  level . (5) 


7.  GS-13 

1 .  Less  than  4  hours . ( 1 ) 

2.  4-8  hours . (2) 

3.  9-16  hours  . (3) 

4.  More  than  16  hours . (4; 

5.  None  done  at  this  level . .(5) 

8.  GS-12  Scientist,  Engineer 

1.  Less  than  4  hours . (1) 

2.  4-3  hours . (2) 

3  .  9-1G  hours . (  3  ) 

4.  More  than  16  hours . (4) 

5.  None  at  this  level . (5) 

9.  GS-12  Technician,  Administrative,  Specialist 

1 .  Less  than  4  hours . ( 1 ) 

2.  4-8  hours . (2) 

3.  9-1G  hours . (3) 

4.  More  than  1G  hours . (4) 

5.  None  at  this  level . (5) 

,  GS-5/11  Engineer,  Scientist,  Technician,  Administrative 

1.  Less  than  4  hours . (1) 

2.  4-8  hours . (2) 

3.  9-16  hours . (3) 

4.  More  than  16  hours . (4) 

5.  None  at  this  level . (5) 

11.  Clerical/Secretarial/Assistant  (NOSC  only) 

1 .  Less  than  4  hours . { 1 ) 

2 .  4-8  hours . . . ( 2 ) 

3.  9-16  hours . (3) 

4.  More  than  1G  hours . (4) 

5.  None  at  this  level  . . (5) 
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After  final  preparation,  about  how  many  working  days  did  i 
usually  take  for  final  approval/classification  of  each  of  th 
following: 

12.  GS-14/15 

1 .  Less  than  4  (lays  . ( 1 ) 

2 .  4-8  days . (2) 

3 .  9-16  days . (  3  ) 

4.  17-30  days . (4) 

5 .  More  than  30  days . ( 5 ) 

6.  None  at  this  level . (6) 


13.  GS-13 

1.  Less  than  4  days  . (1) 

2.  4-0  days . (2) 

3 .  9-16  days . (  3  ) 

4.  17-30  days . (4) 

5.  More  than  30  days . (5) 

6.  None  at  this  level . (6) 

14.  G3-12  Scientist,  Engineer 

1.  Less  than  4  days  . (1) 

2.  4-8  days . (2) 

3.  9-16  days . (3) 

4.  17-30  days . (4) 

5.  More  than  20  days . (5) 

6.  None  at  this  level . (6) 

15.  GS-12  Technician,  Administrative,  Specialist 

1.  Less  than  4  days  . (1) 

2 .  4-0  days . ( 2 ) 

3  .  9-16  days . ( 3 ) 

4.  17-30  days . (4) 

5.  More  than  30  days . (5) 

6.  None  at  this  level . (6) 

16.  GS-5/11  Engineer,  Scientist,  Technician,  Administrative 

1.  Less  than  4  days  . (1) 

2 .  4-0  days . ( 2 ) 

3.  9-16  days . (3) 

4.  17-30  days . (4) 

5.  More  than  30  days . (5) 

6.  None  at  this  level . (6) 

17.  Clerical/Secrctarial/Assistant  {NOSC  only) 

1.  Less  than  4  days . (1) 

2 .  4-0  days . ( 2 ) 

3.  9-16  days . (3) 

4.  17-30  days . (4) 

5.  More  than  30  days . (5) 

6.  None  at  this  level . (6) 
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During  a  one  year  period,  about  how  many  position  descriptions  of 
each  of  the  following  types  were  prepared  in  the  organization 


which  you  supervised?  (Consider  those  needed  for  recruitment, 
reassignment,  update  for  currency,  promotion,  etc. ) 

18.  GS-14/15 

1 .  None . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (6) 

19.  GS-13 

1 .  None . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6 .  Over  4C . (6) 

20.  GS-12  Scientist,  Engineer 

1 .  None  . . ( 1 ) 

2.  1-3  . (2) 

3.  4-10  . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (6) 


21.  GS-12  Technician,  Administrative,  Specialist 


1 .  None  . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-43 . (5) 

6.  Over  40 . (6) 


22.  GS-5/11  Engineer,  Scientist,  Technician,  Administrative 


1 .  None . ( 1 ) 

2.  1-3 . (2) 

3.  4-1U . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (0) 

23.  Clerical/Secretarial/Asaistant  (NOSC  only) 

1 .  None  . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (6) 
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24.  How  many  position  descriptions  in  your  organization  were 

typically  out  of  date  or  inaccurate? 


1 .  None . ( 1 ) 

2.  1-10% . (2) 

3.  11-25% . (3) 

4.  20-50% . (4) 

5.  51-99% . (5) 

6.  All . (6) 

25.  Were  any  inaccuracies  primarily: 

1 .  Major . ( 1 ) 

2.  Minor . (2 ) 

26.  IJhat  was  the  major  reason  for  not  updating 
position  descriptions: 

1.  It  took  too  much  time . (1) 

2.  There  was  no  payoff . (2) 

3.  Didn't  want  to  jeopardize  employee's  GS 

rating . ( 3  ) 

4.  Accuracy  of  P.D.'s  wasn't  important  enough  to 

spend  the  time  and  effort  updating  them.  .  .(4) 

5.  Not  appl  icao le . (5) 


2".  On  the  average  about  how  many  timer,  per  year  did  ycu 
actually  use  or  refer  to  an  established  position 


description  in  your  organization? 

1 .  Never . ( 1 ) 

2.  1-2  times  each . (2) 

3.  3-5  times  each . (3) 

4.  More  than  5  times  each . (4) 

28.  -  31.  What  were  the  major  purposes  for  referring  to  a  PD? 

Use  answer  sheet  items  28-31  to  indicate  up  to  four  purposes 

1.  Performance  appraisal  . (1) 

2.  Instructing/Guiding  employees  . (2) 

3.  Required  reviews  (accuracy,  currency, 

position  management  report,  maintenance 
review,  etc.) . (3) 

4.  Position  management  decisions  . (4) 

5.  Manpower  planning  . (5) 

6.  Recruitment  (prewiring  and/or  requesting 

certificate)  . (6) 

7.  Refer  to  when  miking  assignments . (7) 

0.  Promotion . (0) 

9.  Reass  iqnment . (9) 

10.  Guideline  for  writing  similar  PDs  . (10) 


32.  In  general,  how  useful  were  the  position  descriptions 


to  you? 

1.  Very  useful . (1) 

2.  Moderately  useful . (2) 

3.  Not  useful  . . (3) 

4.  Irrelevant  . . (4) 


5.  Interfered  with  my  job  accomplishment  .  .  .(5) 

33.  In  general,  how  well  informed  or  involved  in  position 
description  preparation  and  the  classification  process  were  ycur 
non-supervisory  employees? 


1.  Little  cr  no  involvement/knowledge  . (1) 

2.  Understood  what  a  P.D.  is  and  its  primary 

uses . ( 2 ) 

3.  Thoroughly  understood  the  process . (3) 


Demonstration  Project  Classification  Experience 


34.  In  the  organization  you  now  supervise,  are  Level/Specialty 
Designators  (NOSC)  or  PACs  (NWC)  usually  drafted  or  written 
by: 

1.  Yourself . (1) 

2.  A  lower  level  supervisor . (2) 

3.  A  staff  assistant . (3) 

4.  The  employee . (4) 

About  how  many  hours  do  you  now  spend  in  preparing,  discussing 
negotiating  over  a  typical  Leve  1 /Specia  lty  Designator  (NOSC)  or 
PAC  (NWC)  in  each  of  the  following  categories? 


35.  DP— IV 

1.  Less  than  1  hour  . (1) 

2.  1-3  hours . (2) 

3.  4-8  hours . (3) 

4 .  9-16  hours . (4) 

5.  Over  16  hours . (5) 

6.  None  at  this  level . (6) 

36.  DP-III 

1.  Less  than  1  hour  . (1) 

2.  1-3  hours . (2) 

3.  4-8  hours . (3) 

4.  9-1C  hours . (4) 

5.  Over  16  hours . (5) 

6.  None  at  this  level . (6) 


57 


37 


DT,  DS,  DA,  III 

1 .  Less  than  1  hour . ( 1 ) 

2 .  1-3  hours . ( 2 ) 

3.  4-8  hours . ' . ( 3  ) 

4.  9-16  hours . (4) 

5.  Over  16  hours . (5) 

0.  None  at  this  level . (6) 

3G.  DP,  DT,  DS,  DA  Levels  A,  I  and  II 

1  •  Less  than  1  hour  . ( 1 ) 

2.  1-3  hours . (2) 

3 .  4-8  hours . (3  ) 

4.  9-16  hours . (4 ) 

5-  Over  16  hours  . . (5) 

6.  None  at  this  level . (6) 

39.  Cierical/Secrtarial/Assistar.t  (NOSC  only) 

1.  Less  than  1  hour . (1) 

2 .  1-3  hours  . . ( 2 ) 

3.  4-8  hours . (3) 

4.  9-16  hours . (4) 

5.  Over  16  hours . (5) 

6.  None  at  this  level . (6) 


58 


After  final  preparation,  about  how  many  working  days  does  it 
usually  take  for  final  approval/classification  of  each  of  the 
following? 

40.  DP-IV 

1 .  1-3  days  . ( 1 ) 

2.  4-8  days  . (2) 

3.  9-16  days . (3 ) 

4.  16-30  days . (4 > 

5.  Over  33  days  . (5) 

6.  None  at  this  level . (6) 

41.  DP-III 

1 .  1-3  days  . ( 1 ) 

2.  4-8  days  . . (2) 

3 .  9-16  days . (3) 

4.  16-30  days . (4 ) 

5 .  Over  30  days . ( 5 ) 

6.  None  at  this  level . (6) 

42.  DT,  DS,  DA  III 

1 .  1-3  days  . ( 1 ) 

2.  4-8  days  (2) 

3 .  9-16  days . ( 3  ) 

4 .  16-30  days . (4 } 

5.  Over  30  days . (5) 

6.  None  at  this  level . (6) 

43.  DP,  DT,  DS,  DA  Levels  A,  I  &  II 

1 .  1-3  days . ( 1 ) 

2.  4-8  days . (2) 

3 .  9-16  days . ( 3 ) 

4.  16-30  days . .(4) 

5 .  Over  30  days  .  . . ( 5 ) 

6.  None  at  this  level . (6) 

44.  Clerical/Secretarial/Assistant  (NOSC  only) 

1 .  1-3  days  . .  ( 1 ) 

2.  4-8  days  . ( 2 ) 

3.  9-16  days . (3) 

4.  16-30  days . (4) 

5.  Over  30  days . (5) 

6.  None  at  this  level . (6) 


59 


Under  the  Demo,  during  a  one  year  period,  about  how  many  PACs 
(NWC)  or  Level/Specialty  Designators  (NC  )  of  each  of 
the  following  types  are  prepared  in  your  organization?  (Consider 
those  needed  for  recruitment,  reassignment,  update  for  currency, 
promotion,  etc.  Do  not  count  those  prepared  for  entering 
employees  into  the  Demonstration  Project  initially.) 

45.  DP  IV 

1 .  None . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6 .  Over  40 . (0) 

46.  DP  III 

1 .  None . ( 1 ) 

2.  1-3 . (2) 

3.  4-13 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (6) 

47.  DT ,  DS,  DA  III 

1 .  None  . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (6) 

40.  DP,  DT,  DS,  DA  Levels  A,  I  &  II 

1 .  None  . ( 1 ) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . . . (6 ) 

49.  Clerical /Socretarial/Assistant  (NOSC  only) 

1 .  None . (1) 

2.  1-3 . (2) 

3.  4-10 . (3) 

4.  11-20 . (4) 

5.  21-40 . (5) 

6.  Over  40 . (6) 
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50.  About  how  many  Level /Specialty  Designators  (NOSC) 

PACs  (NWC)  are  inaccurate  or  out  of  date  ■ 

in  your  organization? 

1 .  None  . ( 1 ) 

2.  1-10% . (2) 

3.  11-25% . (3) 

4.  26-50% . (4) 

5.  51-99% . (5) 

6.  All . (6) 

51.  Do  you  use  L/SD’s  (NOSC),  PACs  (NWC)? 

1.  Less  often  than  P.D.'s . (1) 

2.  About  the  same  as  P.D.'s . (2) 

3.  More  often  than  P.D.'s . (3) 

52. -  55.  For  what  purposes?  (use  answer  sheet  lines  51-54 

to  indicate  up  to  4  major  purposes) 

1.  Performance  appraisal  . (1) 

2.  Instructing/guiding  employees  . (2) 

3.  Required  reviews  (accuracy,  currency,  position, 
management  report,  maintenance 

review,  etc .  ) . ( 3  ) 

4.  Position  management  decisions  . (4) 

5.  Manpower  planning  . (5) 

6.  Recruitment  (preparing  and/or  requesting 

certificate  . (6) 

7.  Refer  to  when  making  assignments . (?) 

3.  Promotion  . (6) 

9.  Reassignment . (9) 

lfl.  Guideline  for  writing  similar  PDs  . (10) 


56.  In  general,  how  useful  are  PACs  (NWC),  L/SD's  (NOSC) 


to  you? 

1 .  Very  useful . ( 1 ) 

2.  Moderately  useful . (2) 

3 .  Not  useful . ( 3 ) 

4.  Irrelevant . (4) 

5.  Interfere  with  my  job  accomplishment  .  .  .(5) 


57.  In  general,  how  well  informed  or  involved  in  L/SD 

(NOSC),  PACs  (NWC)  preparation  and  the  classification 
process  are  your  nonsupervisory  employees  now? 


1.  Little  or  no  involvement/knowledge . (1) 

2.  Understand  what  a  L/SD  (NOSC),  PACs  (NWC)  is  and  its 

primary  uses . ( 2 ) 

3.  Thoroughly  understand  the  process . (3) 
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Please*  provide  your  frank  opinions  below  in  light  of  your 
Demonstration  Project  experience 


Partially  Not  Don’t 
True  True  True  Know 

58.  Classification  is  simpler  £. 
more  understandable 


than  before. 

(1) 

(2) 

(3) 

(4) 

59. 

Classification  takes 
significantly  less  time 
than  before. 

(1) 

(2) 

(3) 

(4) 

61)  . 

Classification  paper  work  is 
significantly  decreased  in  the 
Demo  environment. 

(1) 

(2) 

(3) 

(4) 

Gl. 

Demo  classification  levels 
are  logical  and  reflect  real 
world  differences  in 
difficulty. 

(1) 

(2) 

(3) 

(4) 

62. 

Classification  authority  is 
responsibly  exercised  at 
this  Center. 

(1) 

(2) 

(3) 

(4) 

63. 

Conflicts /classification 
pressures  are  significantly 
reduced . 

(1) 

(2) 

(3) 

(4) 

64. 

Conf licts/classif ication 
pressures  are  eliminated. 

(1) 

(2) 

(3) 

(4) 

65. 

Position  management  is  more 
important  than  before. 

(1) 

(2) 

(3) 

(4) 

66. 

Supervisors  and  employees 
understand  Demo  classification 
better  than  the  GS 
classification  system. 

i 

(1) 

(2) 

(3) 

(4) 

67. 

Other  more  productive  use 
is  made  of  my  time  and 
knowledge  than  under  the  old 
classification  system. 

(1) 

(2) 

(3) 

(4) 

08. 

Relations  between  supervisors, 
employees,  and  personnel 
specialists  are  better  than 
before. 

(1) 

(2) 

(3) 

(4) 
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PARTIALLY 

NOT 

DON'T 

TRUE 

TRUE 

TRUE 

KNOW 

My  personnel  advisors  now 

provide  more  productive 
assistance  than  before. 

(1) 

(2) 

(3) 

(4) 

In  the  personnel  management  areas  listed  below  indicate  whether 
you  have  experienced  increases/decreases  in  work  under  the  Demo: 


ABOUT  DON ‘ T 

INCREASED  SAME  DECREASED  KNOW 


70.  Long  range  planning, 

manpower  needs 
determination,  position 
management.  (1) 

71.  Recruiting,  interviewing, 

selecting  employees.  (1) 

72.  Classification:  preparing, 

reviewing  PACs  or  L/SD*s 
instead  of  PDs.  (1) 

73.  Classification:  negotiation 
with  personnel  advisers.  (1) 

74.  Planning  work  with/for  my 
employees  (including 
development  of 

performance  plans)  (1) 

75.  Developing,  coaching,  on-the- 

job  training  of  my 
employoss .  ( 1 ) 

76.  Reviewing  performance,  mo¬ 

nitoring  sessions, 
appraising  performance, 
providing  feedback  to 
employees.  (1) 

77.  Compensation  (e.g.,  pay  out 

decisions,  salary  management, 
other  monetary  awards, 
performance  review  board 
meetings,  etc.)  (1) 


(2) 

(3) 

(4) 

(2) 

( 3 ) 

!4) 

(2) 

(3) 

(4) 

(2) 

(3) 

(4) 

(2) 

(3) 

(4) 

(2) 

(3) 

(4) 

(2) 

(3) 

(4) 

(2) 

(3) 

(4) 
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ABOUT  DON'T 

INCREASED  SAME  DECREASED  KNOW 


78.  Dealing  with  employee 
management  relations 
natters  (retirements, 
removals,  discipline, 
grievances,  appeals, 

etc.)  (1)  (2) 

79.  Do  you  view  the  net  change  as  an  improvement: 

1 .  Yes  . 

2 .  Mo . 


(3) 


(4) 


(1) 

(2) 


03.  The  GS/WG  performance  appraisal  system  provided  for  "O" 
outstanding,  "S"  satisfactory,  and  “U”  unsatisfactory  ratings.  Mo 
performance  planning  was  required.  In  comparison,  do  you  feel  the 
Demo  Project  performance  appraisal  system  contributes  to  your 
mission  accomplishment?  • 

1.  More  than  the  GS/WG  system  .  *. . (T) 

2.  About  the  same . (2) 

3.  Less  than  the  CS/V’G  system . (3) 


Please  describe  the  parts  of  the  Demo  performance  appraisal  system 
as  follows: 
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rH  U-4 
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iw 
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*cr  2£ 
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4  .H 

cT  iu 

81. 

Setting  objectives/ 

1 

a 

performance  planning. 

(i) 

(2) 

(3) 

(4) 

(5) 

82. 

Monitoring/ review( s ) 

in 

(2) 

(3) 

(4)  . 

(5) 

83. 

Year-end  performance 
appraisal 

(i) 

(2) 

(3) 

(4) 

(5) 

84. 

Rating  definitions 

(i) 

(2) 

(3) 

(4) 

(5) 

85. 

Linkage  with  pay 

(i) 

(2) 

(3) 

(4) 

(5) 

86. 

Management  review  process  (1) 

(2) 

(3) 

(4) 

(5) 

MORE  SAME  LESS 

87.  In  general,  how  much  do  you  (or  your 
subordinate  supervisors)  know  about 
the  work  your  employees  are  actually 
doing  compared  with  what  you  knew 

under  the  GS  system?  (1)  (2)  (3) 
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How  much  communication  about  work, 
expectations  between  the  employees 
and  supervisors  in  your  organization 
is  there  now  compared  with  before 
the  Demo  Project? 

In  general,  how  much  do  you-  feel 
employees  know  about  what  is 
expected  of  them  now  as  compared 
to  before  the  Demo  Project? 


(HOSC)  The  paperwork  required •( Form  NCSC  12433/1), 
Performance  Planning  Appraisal* is: 

1.  Insufficient  for  my  need  . 

2.  About  right  . 

3-  Excessive  . 


(:r.;C)  The  paperwork  required  (NAWPNCEN  12433/S) 
Performance  Plan-Demonstration  Project  and 
(N'AVWPN'CEN  12433/9)  Performance  Assessment- 
Demonstration  Project  is: 

1.  Insufficient  for  my  need . . 

2.  About  right  .  , 

3.  Excessive  . . 


Does  the  time  you  spend  on  performance  planning  and  appraisal 
under  the  Demonstration  Project  contribute  to  your  accomplishment 
of  the  following  tasks:  DJ  .u  i  i 


Vi.  -vcr.g  range  planning. 

93.  Determining  manpower 
requirements . 

94.  ’..‘ork  scheduling. 

95.  Peporting  to  higher 
level  management/sponsors 

96.  Identifying  training 
needs  for  employees. 

37.  Dealing  with  employee 
problems . 
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(i) 

(2) 

(3) 

(4) 

(3) 

(i). 

(2) 

(3) 

(4) 

(5) 

(i) 

(2) 

(3) 

(4) 

(5) 

$ 

’(i) 

(2) 

(3) 

(4) 

(5)  ' 

ft 

(i) 

(2) 

(3) 

(4) 

(5) 
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98. 

Predicting  financial 
requirements 

(1) 

(2)  (3) 

(4) 

(5) 

99. 

Overall  performance  of  my 
job  as  a  supervisor/ 

manager. 

(1) 

(2)  (3) 

(4) 

(5) 

100. 

Overall,  would  you  rather 

work  in 

the  Demo  environment 

than 

in  the  pre-July  1980  personnel  management  system? 

1 .  Yes  . 

2 .  No . 
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COMPUTER  DATA  TABLES 
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